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ABSTRACT 



Previous research on analogy solutions indicated 
that an associative relatedness process was central to the solution 
process* One implication of these findings was that differences in 
associations to the words comprising the items may produce 
differences in test performance and, hence, account for the vast 
differentials in performance of persons of various ethnic and 
sociocultural groups. This study tested Ihis hypothesis by selecting 
two groups of college students of markedly different backgrounds and 
with large differences in analogy test scores. Predictability of 
analogy item rankings from ranked associative re3.ated.ness rtrLlngs 
wi'hin each of the samples fell within the range found in previous 
st lies. It was not possible, however, to attribute differential test 
performances to different associates of the group* (PR) 
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ABSTRACT 



Previous research on analogy solutions indicated tliat an associa- 
tive relaiedness process was central to the solution process. One 
implication of these findings was Thai differences in associations to 
the words crrnpri i ing the items may produce differences In test perfor- 
mance arid, hence, account for Ihe vast differentials in performance 
of persons of various ethnic and sociocultural groups. This study iested 
this hypothesis by selecting iwo groups of college students of markedly 
different backgrounds and with large differences In analogy test scores. 
Predictability of analogy item rankings from ranked associative relatod- 
ness ratings within each of the samples fell within the range found in 
previous studies. It vfas not possible, hov:ever, to attribute differ- 
ential test performances to different associates of the group. 
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One of the most dffficull challenges to cognitive, as v:e I ( as to 
measurement, Iheorisls lies been to account for differences In performance 
on standardized aptitude and achievement tests among various subgroups 
of the population (such as urban vs. rural, male vs. female, black vs. 
While, etc.). A primary reason for this difficulty, of course, is lhal 
the processes subjeefsuse In solving test Items is not well understood, 
end until a theory of the cognitive processes elicited by test items 
|s developed, It would be difficult, if not Impossible, to account for 
differences In solutions. 

Recognizing the Importance of studying the processes Involved 

in test item solutions, a program of research was begun to delineate 

the components of the analogy solution process and thereby provide a 

r\ 

theory of problem solving analogy Items (Gentile, 1967 and 1968; Gentile, 
Kessler and Gentile, 1969), Implicit In these studies was the hope that 
such a delineation In time would provldo an accurate prediction of Indi- 
vidual differences In the solution of these items. Analogies of the 
following form were selected as the Items to be studied since they are 
considered to be measures of reasoning, and slnco they are quite widely 
used In standardized tests: 

FIRE: ASHES:: 

\ , wlnterjlce 

2, tree; leaves 

3. Chrisfmasihol ly 
+ 4, event ’.memories 

Although the previously cited studies do not specify the processes 
of analogical reasoning in any but a pre-thcorel I cal (l,e., I ncomp lete) 
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manner, I he re was a repealed finding lhai an associative mechanism 
accounted for Ihe major proportion of the variance in the solution pro- 
cess. Specifically, rankings of the associative relatedness (the Vford 
Relatedness Rating Scale, see Gentile and Seibel, 1969) of /he four- 
word groups which comprise each alternative choice (e.g., FIRE ASHES 
WINTER ICE, FIRE ASHES TREE LEAVES, etc.) consistently predicted the 
ranked solutions of the analogy items. Supporting a causal interpre- 
tation was an experimental study iri which primed associates in a pre- 
training task wore shown to affect subsequent analogy solutions' (Gentile 
• E/e.m 

et al., 1969). SmcIi data led Gentile el al. to conclude that "the 
A 

process that Ss use in solving analogy Items Is prlmari ly an associative 
process" and that the measure of associative relaledness usecfTT^’appears 
to account for from 28^ to 50^ of the variance (n the analogy solutions" 

(p. 501) . 

Assuming that such variance estimates are approximately accurate, 
this finding implied a simple explanation for the differential perfor- 
mances of different subgroups of the ponu let i on— namely, that differences 
In associations to the words comprising the items are responsible for 
1 ho differences In lest performance. This suggestion can be Inferred 
from the work cf many Investigators (e.g., Bernstein, I960; Hertz lor, 

1965; Jensen, 1967, John, 1963;) and is certainly not a new hypothesis, 

On the other hand, the analogy studies cited above almost mandated some 

test of the hypothesis along ihe lines of the previous studies. This 
l 

paper presents a study designed to yield preliminary data on that question. 

METHOD 

Cliffy L c cE' The Sonora I hypothesis under test throughout Iho 
several previous studies was that the preferences of alternative choices 
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of analogy Items could be predicted from knowledge of iho re latedness . % 
of the words comprising those alternative choices. To measure this, 
subjects are required to rank Ihe analogy alternative choices from best 
to v/orst (1 to 4 or 1 to 5 for four- or five-choice Herns, respectively). 
The rankings of Ihe alternative choices obtained from Ihls group by 
summing across individuals wllhin items const itu+e the criterion to be 
predicted. These subjects are thus referred to as ihe criterion group, 

Another group of subjects receive the Word Relatedness Rating 
Scale (WRRS) in v:hlch they are asked to rate on a nine-point scale (from 
Extreme ly-Easy-io-Re late io Very-OI f f icult-te-Re late) "how difficult It 
would be for you io write seniences showing how the words above ihe rating 
scale are related or go together. M The words to be rated for re latedness 
are Ihe four word groupings which comprise each alternative choice In. 
an analogy Hem. In the sample Hem, for Instance, two of ihe sots of 
words to be raied would be FIRE ASHES WINTER ICE and FIRE ASHES TREE 
LEAVES, These ratings on each set of four v/oras ere summed across 
subjects within each analogy Hern, and these summed ratings ore ranked 
from highest to lowest relatedness (1 to 4 or 1 to 3 for four-^ and 
five- choice Herns, respectively). Those group rankings constitute ihe 
predicted rankings for each Hern, and this group of subjects Is called 
the predictor group. 

Using this general procedure, support for the hypothesis that 

different associates are responsible for different analogy solutions 
I 

would be obtained If each of ihe following conditions held. First, 
two groups of subjects musi be sampled frem populations very different 
In experiential backgrounds (and presumably therefore In associative re- 
sponses io words) and whose performances on analogy Items are markedly 
different. Second, within each sample, WRRS ratings should reliably 
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predict analogy solutions within the range of previous studies. Third, 
there should be zero order between-sampl e correlations on.ihe WRRS ratings 
and on the analogy Hem solutions. 

Su bje c ts . 

Subjects wore 98 siudenls from Lycoming College (LC), Wl 1 1 iarnsport, 
Pa. and 104 students from Texas Southern University (TSU> Houston, Texas, 
Gross comparisons of the ivo schools on the only available data Indicated 
that the socio-economic situations were sufficiently different to jus- 
tify /the assumption that the two samples for this study were drawn from 
different populations. For example, in 1968-69 LC had an enrollment which 
Included !.2£ blacks, Ihe total estimated cost of an academic year 
(including full ion, room and board, books, and fees) was $2700-3200, and 
ihe mean family income of students on aid programs (about { of the student 
population) was $8797 per year,* In contrast, TSU had a 1968-69 enroll- 
ment which was 98* black, had a total estimated academic year cost of 
$1460, and had of the Freshmen coming from families earning less ■ 
than $6000 per year. 

The LC students serving as subjects were bolh underclassmen and 
upperclassmen enrolled In four classes: elementary statistics, educ- 

catlonal psychology, devo lopmenla I psychology, rnd advanced sociology 

(reported In Gentile el al; 1969, Exp. IV). The TSU subjects were all 

* 

Freshmen enrolled in ^ reading end study skills course. 

Analo gy Items. 

FIfleen analogy Hens, selected from the semi-secure item files of 
Educational Testing Service, end previously used by Gentile et el. 

(1969) In Exp. IV were used In this study. These l terns cennoi be printed 
here because of their scml-secure classification, but they are similar 

ion of this paper, with* the 



ERTC 



In form to the sample Mom !n the 



Inf redact 

6 



exception I hat the present items have five alternative choices. One 
random order of Mems v/as used for all subjects. 

Pr^^dure, 

In each of Ihe regularly scheduled classes referred to above, 
subjects were assigned 1o the criterion group (LC: N-50; TSU: N=56) or 
to the predictor group (LC: N"48; TSU; N=48) by a procedure v/hich in- 
sured only that subjects with adjacent seals were in different groups. 

As nolcd above, the criterion group solved the fifteen analogy 
Herns concurrently with Ihe prediclor group’s rating Ihe word sets on 
the WRR5. in addition to the 75 sels of v/ords 1o be rated by Ihe 
predictor group (five in each cf Ihe 15 analogy items), six trios of 
word pairs selecicd from Ihe Pa Icrmo-Jenkl ns < I96t) norms and len sets 
of word triplets selected ’from the Nunna My~Kop I in (1967) norms were 
Included for validity date. The Pa lerro-Jenkl ns v/ord pairs, which had 
been used in the studies referred to previously, were selecicd from 
Iho norms so thal subjects rated a given stimulus word three times: 
paired with a high, medium, and lew frequency response (e.g., CHAIR 
TABLE, CHAIR SEAT, and CHAIR KITCHEN, respectively, were one trio of 
word pairs). In addition, trios of word triplets v/ere randomly selected 
from the Nunna I fy-Kop f i n Joint Meaningfulness table, according to the 
same rule, to give a stimulus pair combined with a high, rradium, and 
low response word (e.g., CORN FIELD FARM, CORN FIELD CROP, and CORN 
FIELO ROOTS were one trio of triplets to be rated). 

i 

All of these sots of words - 75 four-word sets from the analogy 
Items, 30 three -word sets from the Nunna Ify-Kop 1 1 n norms, and 18 two- 
word sots from the Palcrmo-Jenkins norms - wore placed In the rating 
booklet in one random order fcr ail subjects. Because of two misspelled 
words In ihe booklet used at LC, one analogy Hen and one Nunna lly- 
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Koplin sol had 1o bo discarded from Ihc analysis, leaving 14 analogy 
I -ferns and 9'Nunnal ly-KoplIn sefs for Ihe LC analyses only. 
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RESULTS 

As noted oar I i or, a comparison necessary before the tost of the 
hypothesis of interest is that of whether Ihe two sarrp les differ in 
analogy solutions. Therefore, the proportion of correct solutions 
(as Keyed by Educational Testing Service) vas obtained for each subject. 
The mean proportion of con eel responses for the LC sample was .35 
(S«D,-.I6), while for the T$U sample ii was ,25 (S.D.-.I2), yielding 
a t = 12.775, p <.001 . 

Tho predictability for each of the 15 analogy items for the 
wl th I n-sarnp le, as well as the betwean-samp le, comparisons v/ere all 
calculated by the procedure In Table I, which presents the TSU data on 
predl ct abi I i ty of the analogy Hern solutions (the criterion) from the 
WRRS ratings ( tho predictor), Table I shows •’hose data cast Into a 
Friedman Two-V/ay AM OVA by Ranks table (Siegel, 1956) In which the 
heading row is the analogy rankings of the TSU criterion group and 
the body of the table presents the TSU predictor group rankings for 
each it on. 



INSERT TA8LE I A30UT HERE 

^ This analysis yielded a x* - 26,28 (p. <.001, df-4), which indicates 

a highly significant relationship between the predicted (by the WRRS 

ratings) and actual (from analogy solutions) rankings for Ihe 15 analogy 
/ 

Herrs for ihe TSU subjects* The extent of this relalionship was esti- 
mated by calculating the mean runk-order correlation of these 15 I tcrrs ; 
which was .65. 

Similar procedures vrere used to estimate tho in terre la+i onsh I ps 
between the various combinations of LC and TSU predictor and criterion 
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groups, and the mean correlations are presented In Tuble 2, Included 
in Table 2 as Ihe correlation of variables 3 and 4 is ihe *65 rho 
discussed in Ihe Iasi paragraph. The comparable data for Ihe LC group 
Is the correlation of variables 1 and 2 , which was ,53* These results 
Indicate that Ihe Y/RRS ralings do predict significantly the analogy 
solutions v/Mhfn bolh the LC and TSU groups. I nterpre fation of the 
remaining correlations in Table 2 are deferred to the discussion. 



INSERT TABLE 2 ABOUT HERE 



Similar analyses were conducted on the normative pairs of Palermo- 
Jenkins and trios of Nunna 1 ly-Kop I ! n (presented In Table 3), 



INSERT TABLE 3 ABOUT HERE 
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DISCUSSION 
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The mean rank-order correlations presenled In Table 3 replicate 
the previous relations between the V/RRS and normal ive measures of 
associative relatedness (Gentile and Seibel, 1969; Gentile et al., 

1969), and add further support to the argument that within both the 
LC and, TSU students sampled, assoclallve relatedness reliably predicts 
analogy solutions. Thus far, then, the results of this study satisfy 
the first two conditions necessary (see the General Overview) for the 
hypothesis of different associates being responsible for different 
solutions to analogy items. The final condition to be satisfied is to 
obtain Eero-ordor correlations between-samp les on the W'RRS ratings of 

3 

words In analogy items and on analogy solutions. 

Returning to fable 2, however, presents difficulties for the 
hypothesis, since the mean correlation/ between the LC and TSU students 
on the WRRS ratings was ,72. This Indicates good agreement between the 
samples on the relatedness of word groups. Further, although there was 
a very large difference in proportion of analogies solved correctly 
(J.e., ranked 1), there was a significant tendency for both samples to 

rank the alternative choices of each analogy Item In a similar manner, 

l. 

jfas indicated by the mean rho of .49. These two correlations Indicate 
that there is substantially more agreement between the TSU and LC 
students in their ratings of associative relatedness of words ^han was 
expected (supporting the results of a normative study b/ Belcher and 
Campbell, I96S) . 

The final two correlations to be discussed are extremely interesting 
and provocative. T he LC WRRS ratings correlate ,69 with the TSU analog/ 
solutions, which is os high as the WRRS ratings of the TSU predictor 
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group correlated v/I th the analogy solutions of Ihe TSU criterion group: 
.65. In conlrast, Ihe TSU WRRS ratings show a rero-order correlation 
(rho=,25) with the LC analogy solutions. This finding suggests that 
the analogy solution process of Ihe TSU students is much more of an 
associative process than is the process used by the LC students. 

In other wo, ds, analogy Items appear to be solved by some mechanism 
whereby the words comprising each alternalive cholce’are compared a I eng 
the dimension of associative relaledness. However, the solution process 
of those subjects who score poorly on analogy I terns Includes more of 
thisassoclal I ve relaledness mechanism than does the process of those 
subjects who serve we 1 1 (an Interrelation suggested by V/I I Iner, 1964), 
The something extra that the high scorer^s do remains te be specified, 
concurrently with an elucidation of the remaining dimensions of the 
processes required to solve analogy items. 
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FOOTNOTES 



1. Appreciation is extended to Mr, John J. Fremer, Jr, of Educational 
Testing Service for his aid in obtaining the items used in this study; 
to Mr. John G. Hancock, Dr. David J. Loomis, Mr, Lee B, Ross, and 
their students for permission to use their class time to collect these 
data; fo Mr. Hunter M. Breland for transcr i pi ion of data; and to 

Miss Delores Kessler Kennedy and Mrs. Patricia K. Gcntf le for their 
help during several sieges of this study. 

2. Presumably fhe family income of sfudents not receiving aid was higher, 
allhough dafa were not available. 

3. There is no necessary contradiction between expecting zero-order corre- 
lations between samples on the WRRS ratings of words appearing in 
analogy I terns and large positive correl si ions' belwoon samples on the 
WRRS ratings of words appearing In the norms, because the latler are 
high frequency words in the language, while Ihe former cover the range 
from very frequent to very Infrequent. 
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table: i 



Prcdl cl abi I Ity of Rankings of Alternative Choices on 15 Analogy Iteus 

for the TSU Students 





1 


. Analogy Rankings (Criterion) 
2 3 4 


5 


Abs. 

Diff, 


rho 


1 


3 


5 


2 


1 


4 


10 


-.200 


2* 


1 


4 


3 


2 


5 


4 


.675* 


3 


2 


1 


4 


3 


* 5 


4 


.800 


4 


2 


1 


4 


3 


5 


4 


.800 


1 terns 5 


2 


3 


1 


4 


5 


4 


.700 


6 


1 


2 


5 


3 


4 


4 


.700 


7 


1.5 


1.5 


4 


3 


5 


3 


.875 


8 


1 


2 


3 


4 


5 


0 


.1.000 


9 


1 


4 


2 


5 


3 


6 


.500 


10 


3 


1 


2 


4 


5 


4 


.700 


11 


1 


2 


3 


4 


5 


0 


1.000 


12 


1 


4 


3 


2 


5 


4 


.600 


13 


1 


2 


3 


4 


5 


0 


1.000 


14 


2 


3 


1 


4 


5 


4 


.700 


15 


2 


• 

i 


5 


4 


1 


8 


100 


Sum 


24.5 


38.5 


45 


50 


67 







Note: Crllerion rankings (row I) are based on 48 Texas Southern University students 1 

analogy solutions. Predictor rankings (body of table) are based on 56 TSU stu 
dents 1 V;RRS ratings, x^ r 26.28 (p<.001, df = 4>. Mean rho - .65. 

^Includes a 3.5 tie on the analogy rankings: one Is therefore considered a 3, 

the other a A, In a conservative direction for calculation of x** The tie 
is Included in the calculation of rho. 
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TABLE 2 



Mean Rank-Order Correlalions of Analogy Solutions and 
Word Rela+edness Ratings of Lycoming College Students 
and Texas Southern University Students 



Varl ab !es 


2 3 4 


1. Analogy Solutions (LC) N = 50 


.53 • .49 . 25* 


2. WRRS (LC) N = 48 


.69 * .72 


3. Analogy Solutions (TSU) N = 48 


.65 


4. WRRS (TSU) M = 56 





Note: x 2 values association with each mean rho provided above vie re 

r * 
all highly significant (p<.01 or better) except Cp> • 1 0 ) - 
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TABLE 3 



Mean Rank-Order Correlations of Word Re I atedness Raiings and Two 
Sets of Norms (Palermo-J enkl ns and Nunnal I y-KopMri) for Lycoming 
College Students and Texas Southern University Students 



Vari ab les 


2 3 4 


1. Palenro-Janki ns Norms 


.75 .92 


2. Nunnal ly-KopI In Norms 


.78 .60 


3. WRRS (LC> N = 48 


.63 


A . WRRS (TSU) N = 56 





Note: x 2 r values associated v/ilh each no an rho provided above 

slgnlficanl (p<.05 or better). 
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